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ABSTRACT 

I calculate the noise in the measured correlation functions and spectra of digitized, noise- 
like signals. In the spectral domain, the signals are drawn from a Gaussian distribution with 
variance that depends on frequency. Nearly all astrophysical signals have noiselike statistics of 
this type, many with important spectral variations. Observation and analysis of such signals at 
millimeter and longer wavelengths typically involves sampling in the time domain, and digitizing 
the sampled signal. (Quantum-mechanical effects, not discussed here, are important at infrared 
and shorter wavelengths.) The digitized noise is then correlated to form a measured correlation 
function, which is then Fourier transformed to produce a measured spectrum. When averaged 
over many samples, the elements of the correlation function and of the spectrum, follow Gaussian 
distributions. For each element, the mean of that distribution is the deterministic part of the 
measurement. The standard deviation of the Gaussian is the noise. Here I calculate that noise, 
as a function of the parameters of digitization. The noise of the correlation function is related to 
the underlying spectrum, by constants that depend on the digitization parameters. Noise affects 
variances of elements of the correlation function and covariances between them. In the spectral 
domain, noise also produces variances and covariances. I show that noise is correlated between 
spectral channels, for digitized spectra, and calculate the correlation. These statistics of noise are 
important for understanding of signals sampled with very high signal-to-noise ratio, or signals 
with rapidly-changing levels such as pulsars. 

Subject headings: methods: data analysis - techniques 



INTRODUCTION 



1.1. Correlation Functions and Spectra 



Electric fields from nearly all astrophysical sources are indistinguishable from Gaussian noise. Thus, 
nearly all of the information in such signals lies in variances of and covariances between electric fields of 
different polarizations, spatial locations, or frequencies. Spectra and cross-power spectra are estimates of 
the variance or covariance of the electric field as a function of frequency. These spectra are the Fourier 
transforms of auto- or cross-correlation functions. Such correlation functions are the averaged products of 
pairs of elements drawn from the series, for a range of time offsets or "lags" . The elements are drawn from 
separate series for cross-correlation, and from the same for autocorrelation. The resulting correlation, as a 
function of lag, is commonly averaged over enough realizations to provide the desired signal-to-noise ratio. 
The correlation function is then Fourier transformed to form the desired cross-power or autocorrelation 
spectrum, as a function of frequency. In practice, correlation and averaging can take place before or after 
the Fourier transform; this makes little difference to the result from the standpoint of this paper. 
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Oftcn, data are digitized before correlation. For bandwidths that are within the capability of digital 
circuitry, processing is usually more accurate and economical for digital signals than for analog signals. 
Digitization involves sampling, or averaging over time intervals; and quantization, or describing the signal 
amplitude in each interval as one of a discrete set of values, rather than as a continuous variable. Quantization 
is an intrinsically nonlinear operation that destroys information, unlike the linear operations of sampling and 
Fourier transform. I find that quantization introduces effects similar to noise in the final result, as one might 
perhaps expect. 

Usually observers wish to minimize noise, while maintaining an invertible, deterministic relationship 
between the mean correlation and the underlying covariance. Optimal parameters for quantization, and 
errors from departures from those parameters, are topics of classic work in radio astronomy (see, for example, 
Cooper (1970); Hagen & Farley (1973); Kulkarni & Heiles (1980); D'Addario et al. (1984) and references 
therein). Calculation of the actual noise level can be important when signal strength varies rapidly, and 
quantizer settings cannot remain optimal, as is sometimes the case for pulsars (Jenet & Anderson 1998); or 
when the distribution of the intensity of the signal must be measured accurately (Gwinn ct al. 2000). As 
sensitivities of radiotelescopes improve, and as demands on the observed data increase, calculation of the 
noise level from quantizer parameters can be expected to become more important. 

Because correlation functions and spectra are averaged over many realizations, the Central Limit Theo- 
rem implies that the resulting correlation function or spectrum has Gaussian statistics. Thus, the statistics 
of the spectrum are fully described by each spectral channel's mean and variance, and covariances between 
channels. The mean of the spectrum is the deterministic part of the measurement; variances and covariances 
are the random part, or noise. In principle, one seeks to minimize the noise, while preserving the relation- 
ship between the mean and the underlying spectrum. In Gwinn (2004) (hereafter Paper 1), I discussed this 
problem for "white" signals, which have zero correlation except for elements of the two series with zero lag. 
Here I consider the more general case, where signals have arbitrary spectral character, so that covariance 
can depend on lag. The effect of quantization on the statistics of such "colored" spectra, particularly their 
noise, is the subject of this paper. 

I calculate the noise in the quantized cross- and autocorrelation functions. The noise differs from that 
for correlation of continuous data in additional terms, some of them constant and others proportional to the 
autocorrelation function, and products of auto- and cross-correlation functions. I present this calculation 
through second order in correlation. 

I then Fourier transform these expressions to determine the mean spectrum and its variance. The mean 
spectrum is simply the Fourier transform of the mean correlation function, while the noise in the spectrum is 
a double Fourier transform of the noise in the correlation function. I find that in the spectral domain, a gain 
factor, and white noise added in quadrature, approximately represent the effects of quantization in a single 
channel. The added white noise is commonly known as "quantization noise" . Indeed, the gain factor and the 
noise are identical to those previous workers found for the deterministic, mean spectrum (Cooper 1970; Jenet 
& Anderson 1998). However, I also show that noise is correlated across spectral channels. This covariance 
can reduce, or increase, the total noise in the spectrum, depending on the details of the quantization scheme 
and the details of the spectrum. For "white" signals without spectral variation, the more general result 
of this paper reduces to that found in Paper 1. In this case, the correlations or anti-correlations of noise 
between channels can represent an effect of the same order as quantization noise, when integrated over all 
channels of a spectrum. 
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1.2. Organization of this Paper 

I consider cross-correlation of two time series, x and y, and autocorrelation of x. In §2 I introduce these 
underlying complex time series xg and ye and describe their assumed statistical properties. I calculate the 
mean and variance of their correlation function and its Fourier transform. I show that covariance of noise in 
different spectral channels is zero for correlation of the continuous (un-digitized) series. 

I introduce information-destroying quantization in §3. Under the assumption that the covariances are 
small (except for the zero lag of the autocorrelation function, which must be 1), I calculate the mean and 
the variance of the quantized correlation function for quantized data, and present analytic expressions for 
them. I compare the analytical results with computer simulations and find excellent agreement. 

In §4 I find the statistics of the cross-power and power spectra. The cross-power spectrum is the Fourier 
transform of the cross-correlation function; and the power spectrum (sometimes called the autocorrelation 
spectrum) is the Fourier transform of the autocorrelation function. I calculate the noise in the spectra 
by a double Fourier transform of the noise in the correlation functions. I show that the noise in a single 
spectral channel can be approximately represented by a gain factor and white "digitization noise" added 
in quadrature with the original signal. However, I also show that noise is correlated (or, more commonly, 
anti-correlated) across spectral channels. I present analytical results for autocorrelation functions, and 
autocorrelation spectra, in §3.7 and 4.4. I summarize results in §6, and show that correlations of noise 
between channels can represent an effect of the same order as quantization noise, when integrated over all 
spectral channels. 



2. CORRELATION FUNCTIONS AND SPECTRA OF CONTINUOUS SIGNALS 

2.1. Time Series of Gaussian Noise 

Consider time series X£ and ye- These might be, for example, the electric fields recorded as analog signals 
at two antennas. All elements of each are drawn from Gaussian distributions in the complex plane. The 
distributions have zero mean. I further assume that the series are stationary, so that the properties of xe 
and ye are independent of the time index I. Thus, the variance of each series is constant, and the covariances 
between elements can depend only on their time separation and whether they belong to the same or different 
series. The ensemble-average spectra, defined in §2.2.2 below, depend only on these variances and covariances. 

For this paper, I assume that the series are statistically identical, in the sense that the exchange of x and 
y leaves the statistical properties of the spectra unchanged. Instrumental effects often violate this assumption 
in a mild fashion, as by variations in complex gain between two antennas. Sometimes the assumption is 
violated in a more fundamental way, as in spatial variation of the spatial and spectral character of scintillating 
sources (Desai et al. 1992; Jauncey et al. 2000; Dennett-Thorpe & de Bruyn 2002). This assumption can 
easily be relaxed, by defining separate autocorrelation functions for the two series in the results below. 

For convenience, I scale variances of real and imaginary parts of the series xe and ye to 1. (This is 
in accord with much of the literature on quantization, which assumes real series with unit variance.) The 
variances are then: 

k(x t x* t ) = l(y t y* t ) = l. (1) 

Here, the angular brackets (...) indicate a statistical average, over an ensemble of time series with identical 
statistics. 
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I assume that the time series have no particular intrinsic overall phase, so that the transformation 

x t -> xee*, y e - W e'* (2) 

leaves the variances and covariances unchanged. Consequently, products of factors with the same conjugation 
average to zero: 

(xty m ) = (x e x m ) = (y e y m ) = 0, (3) 

for any I and m. 



2.2. Mean Correlation Function and Spectrum: Continuous Data 

2.2.1. Mean Correlation Function 

The covariances between elements in the series x and y are given by the statistically-averaged cross- 
correlation p T , and the statistically-averaged auto-correlation a T : 

Pr = \{xzy* l+T ) (4) 
a T = \{x t x* l+T ) = ±(y e y* e+T ). 

Note the conjugation symmetry of a T : 

a T = a*_ T . (5) 

Eq. 1 gives ao = 1. 

Measurements seek to estimate the statistically-averaged correlation functions via the finite averages: 

r - = ^rE^^V ( fi ) 
° i=i 

° 1=1 

Here, N is the number of elements observed in each series. 

I assume that the correlation functions "wrap," in the sense that: 

x (t) = X(e+N a ),y(e) = V{i+n ) for all I. (7) 

Then, the sums in Eq. 6 contain the same number of terms, for each r. This simplifies counting arguments 
below. Also, of course, r T = r T+No ; this simplifies discussion of the Fourier transform to spectra. Note that 
in practice, many correlator do not "wrap" in this fashion. They zero-pad the data so that xe y} +T = 0, if 
cither £ or I + r is greater than N Q or less than zero. The issue is moot if the number of lags correlated 
is smaller than the span of data N a , or for "FX" correlators, which correlate in the frequency domain. 
Otherwise, it can affect the noise, through uneven sampling of a in Eq. 14 below. I will discuss the effect 
heuristically in a separate paper, in comparison of theory with measurements. 

With the definitions in Eq. 6, 

(rr) - Pr (8) 

(o T ) = a T . 

Note that Greek letters p and a denote the statistically-averaged quantities, whereas roman letters r and a 
denote the observed, finite averages. 
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2.2.2. Mean Spectrum 

The statistically-averaged cross- and auto-correlation functions are related to the cross-power and au- 
tocorrelation spectra by Fourier transforms: 

N-l 

Pk = Yl ei ™ kT Pr (9) 

T = -N 

AT— 1 

T = -N 

Here, 2N is the number of frequency channels. Note that is real, because of the conjugation symmetry 
of a T . Other conventions for the Fourier transform have been used in the past. The present convention has 
the advantage that the spectrum &k has values that are independent of numbers of samples N Q or of spectral 
channels 2N. 

Similarly, I define the measured cross-power and autocorrelation spectra, 

N-l 

f fc = e^ kT r T (10) 

T = -N 

AT— 1 

a k = ^2 e l ^ kT a T . 

T = -N 

So, by Eqs. 8 and 9, 

(fk) = Pk (11) 
(ak) = a k . 

As a simple example, a "white" spectrum with a spectrally-uniform correlation p w has &k = 1 and 
Pk = Pw Then, only the zero lags of the statistically-averaged correlation functions will have nonzero values: 
«o = 1 and po = pw For all other lags r, a T = p T = 0. 



2.3. Noise: Continuous Data 

2.3.1. Noise for Correlation Function 
The variance of the observed correlation function describes the noise. We therefore seek: 

j N N 

( rTr «) = JON \2 12 12 ( x tVt+T X mVm+v)- ( 12 ) 
<=lm=l 

The fourth moment of elements drawn from a Gaussian distribution is related to their second moments, so 
that: 

) = (xeyt +T )(x* m y m +v) + (x e x* m )(y} +T Vm+v ). (13) 

A third product of second moments, (x e y m+v ) (yl +T x*^) > would ordinarily appear on the right-hand side of 
Eq. 13, but vanishes here because of the assumption that x and y have no intrinsic phase (Eq. 3). Eq. 6 
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gives the second moments, so that Eq. 12 becomes: 

(rrK) = PrPv + ^J" E a na- n +(r-v)- (14) 

Here, I have used the "wrap" assumption for the correlation function (Eq. 7). The variance is thus: 

(r T r* v ) - (r T )(r* v ) = — ^ a„a_ n+(T _ v) . (15) 

° n=l 

Three variances, or two principal axes and an angle, are required to fully describe the elliptical dis- 
tribution of noise in the complex plane. Because r T r* is always real, we require two more. A convenient 
independent statistic is: 

(r T r v ) - (r T )(r v ) = — ^ PnP- n +(r- v y (16) 

n=l 

This expression is, in general, complex and thus provides the needed additional two statistics. As an example, 
one can easily recover the expressions given in Paper 1 for the noise of a "white" spectrum, for continuous- 
valued data, from Eqs. 15 and 16. 



2.3.2. Noise for Spectrum 

The variances of the spectral channels give the noise. One can obtain the variance by Fourier trans- 
forming Eq. 14: 

N-l N-l 

= E E ^^-"VtO (17) 

t=—N v=—N 

= PkP k + -jj-a k a k . 

This uses the fact that the Fourier transform of the autocorrelation function is the power spectrum (Eqs. 
A4,A5). I assume here that all nonzero elements of the correlation functions a T , p T lie within the range 
that is transformed to a spectrum, — N < t < N — 1. In other words, the spectral resolution is sufficient to 
completely resolve all features of the spectrum. Also, I again use the wrap assumption, Eq. 7. Thus, 

2N 

{f k fl) - {f k ){f* k ) = —a k a* k . (18) 



Analogously from Eq. 16 one finds: 



27V 

(r-fef fe ) - (f k )(f k ) = —p k Pk- (19) 



Together, Eq. 18 and 19 describe the noise of the cross-power spectrum. Note that the noise, measured 
as the standard deviation, increases proportionately with the square root of the number of spectral channels 
V2N, and decreases as the inverse square root of number of measurements \/2N . Each of the N a complex 
terms in the correlation function involves measurement of two quantities, so that for counting arguments the 
number of independent data is actually 2N a . 
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If we suppose that a particular element pk of the cross-power spectrum is real (or, equivalently, if we 
rotate the phase of x until pk is real!), then Eqs. 18 and 19 show that: 

(Re[f fc ]) = h (20) 

(Im[f fc ]) = 

2N 

(Re[r fe ]Re[f fe ]) - (Re[h])(Re[f k }} - ^(l^l 2 + Pi) 

IN 

(Im[r fe ]Im[f fe ]) = _(|a fe | 2 -p 2 fe ) 

(Re[ffe]Im[f fe ]) = 0. 

These equations describe the error ellipses in the complex plane for spectral measurements. They are 
consistent with the results of Paper 1 for a white spectrum (a k = 1, pk = const) , and are closely related to 
"self- noise" (see Paper 1). 

The noise in the measured autocorrelation spectrum dk is identical to that in the cross-power spectrum 
ffc (Eq. 19 or 20), with substitution of ctk for pk- 



2.3.3. Noise is Uncorrelated Between Spectral Channels 
The correlation of noise between spectral channels can be found from a generalization of Eq. 18: 

N-l 

(f fc f?) = Yl j {kT - iv) (r T r* v ) (21) 

t,v = — N 

ON N ~ 1 N ° 

v,fj,— — N m,n—l 

= 0, unless t = m. (22) 

Here, I have introduced p, = r — v. The summation over v yields zero unless t — m (in which case one 
recovers Eq. 18). Thus, noise is uncorrelated between different channels, for the spectrum of a continuous 
signal. 



3. CORRELATION FUNCTIONS OF QUANTIZED SIGNALS 

3.1. Quantized Gaussian Noise 

Suppose now that the time-series xg and yg are quantized, to produce the time series xg and yg. Quan- 
tization involves converting value of the continuous variables xg and yg to one of a discrete set of values via 
a characteristic curve. Fig. 1 shows an example, for 4-level quantization. Such curves can be parametrized 
by the locations of the steps, {v xi } and {v yi }, and the weights of each step, {ni}. I assume that the same 
curve is used for the real and imaginary parts of both xg and yg, although the curve for xg may differ from 
that for yg. I also assume that the characteristic curve is antisymmetric for both real and imaginary parts: 
X(X) = —X(—X), where X is the real or imaginary part of x; and analogously for y. Paper 1 discusses ad- 
ditional details of quantization, with references. Quantization will preserve some properties of the continuous 
signals and their correlation functions and spectra, and change others, as this section investigates. 
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3.2. Correlation Function for Quantized Data 

From the quantized time series xg and ye, one can form the cross-correlation function f T , 

1 N a 
° t=\ 

and the autocorrelation function of x: 

^ = ^rJ2 ilS: i+r- ( 24 ) 

° e=i 

Again I use the "wrap" assumption, Eq. 7. Note that a may differ for the series x and y because of differences 
in characteristic curves, as well as for reasons noted above. One seeks to relate f T and a T as closely as possible 
to the ensemble averages for continuous data, p T and a T , via a simple deterministic relationship and with as 
little noise as possible. 

Among the classic treatments of correlation of quantized signals are the works of Cooper (1970) and 
Jcnet & Anderson (1998). In the notation of Paper 1 and the following sections, Cooper found that f(p) 
is proportional to p, for small p, and determined the constant of proportionality. Jenet & Anderson (1998) 
pointed out that this proportionality is quite accurate until p approaches 1 closely, where the departure 
becomes significant. Most cross-correlations of astrophysical data yield small p, justifying the linear approx- 
imation. However, for autocorrelation, the "zero lag" must yield unit correlation: a = 1 (see §2.2 above), 
for which the linear approximation is poor. Jenet & Anderson concluded that the autocorrelation function 
for quantized data is nearly proportional to the desired result a T , with an additional spike at zero lag. 



3.3. Simulations of Cross-Correlation 

For comparison with analytical results, I simulated correlation of Gaussian noise. Figure 2 shows the 
average spectra and correlation functions for one simulation, with 2N = 8 lags, used as an example in the 
rest of the paper. The autocorrelation function is "white" with a T = 1 for r = 0, and a T = for t ^ 0. 
The cross-correlation function has only 2 nonzero lags, r = 1, 2: pi = p 2 = 0.4. Note that this is somewhat 
different from typical radioastronomical data, which typically contain a white background noise spectrum 
(which appears as a spike in the autocorrelation function at r = 0), with an admixture of spectrally- varying 
noise, perhaps with varying correlation. 

I formed the original noisclike data for Figure 2 by drawing elements from Gaussian distributions for each 
spectral channel. This method reflects the underlying assumption that the spectrum consists of a number 
of independent spectral components with different frequencies. For each spectral channel, the Gaussian 
distribution had unit variance (as indicated by the flat autocorrelation spectrum = 1 in the upper panel 
of Figure 2). However, correlations between the conjugates of Xk and yu varied with spectral channel k, to 
yield the spectral variation of pu seen in the figure. Paper 1 (§ 4) describes formation of such a distribution. 
For this work, the phase of one series was rotated, in each channel, to produce the phase desired for pk ■ I 
then Fourier transformed these frequency-domain data to the time domain, to produce the series xg and yg. 
This yielded Gaussian noise with the desired correlations. I then quantized these series using a characteristic 
curve as in Figure 1 with v = 1.5, n = 3 to form the series xg, yg. After quantization, I correlated the 
time series to produce the correlation function f T . I discuss Fourier transform of r T to form the quantized 
spectrum in §4 below. 
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The predictions of Cooper (1970) and Jenet & Anderson (1998) for the average correlation function, 
re-derived in the following section, agree with the simulation to much better than the size of the points in 
the figure. In the following sections, I calculate the expected noise in the correlation function, and compare 
results with simulations of this spectrum. 



3.4. Mean Cross-Correlation Function for Quantized Data 

To introduce the analytical technique used to find the noise below, I re-derive the results of Cooper 
(1970) and Jenet & Anderson (1998). Eq. 23 gives the ensemble-average autocorrelation function: 

vv> = ^r£<^+r>- (25) 

The quantity (xey^ +T ) is of the form (wx*), where w and x are quantized random variables. This average 
can be expanded into products of pairs of real and imaginary parts of w and x: 

(wx*) = ({Re[w}Re[x}) + (Im[w]Im[i]» + i((lm[w]Rc[x}) - (Rc[w]lm[x])) . (26) 

The various averages of the real quantized Gaussian variables on the right-hand side of this equation arc 
given in Table 1; in this case, by the first line: (WX) = B\yBxPwx- Here, W and X are real (or 
imaginary) variables drawn from the bivariate Gaussian distribution with covariance pwx, and W and X 
are their quantized counterparts. The statistical average (...) is an integral over the probability distribution 
for W and X, times the characteristic curves for W"(W) and X(X). In § 3.2.1 of Paper 1, this expression 
was expanded in powers of p X y to yield the term in the second column of Table 1, times one-dimensional 
Gaussian distributions of W and X and their characteristic curves. Integration over X and Y yields the 
term in the third column in Table 1. 

As Eq. 26 shows, several expressions of the form (W(W)X(X)) must be combined to find the complex 
average (wx*). The covariances of the various real and imaginary parts can be combined to form a complex 
covariance, pwx- 

(Re[w]Re[x]) = (lm[w]lm[x\) = Rc[p wx ] (27) 
(Im[w]Rc[a:]) = — (Rc[io]Im[x]) — Im[pwx]- 

One thus obtains the expression for (wx*) given in the first line of Table 2, in the third column: 

(wx*) =2[B x B Y ]p wx . (28) 

Note that this result is accurate through second order; as discussed in Paper 1, the next correction is 
third-order. Substitution into Eq. 25 recovers the result of Cooper (1970), here with complex correlations: 

(f T ) = B x B yPt . (29) 



3.5. Mean Autocorrelation Function for Quantized Data 

As Jenet & Anderson (1998) point out, the mean autocorrelation function must be treated differently 
from cross-correlation. Eq. 24 gives the ensemble-average autocorrelation function: 

(«r) = ( £ i £ t+r)- ( 30 ) 

° e 
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This involves products of different elements for t / 0, and square moduli of elements for r = 0. Thus, it 
involves terms of both the form (wx*), and of the form (ww*). The first is the same as for cross-correlation; 
the second requires a different, though analogous, calculation. The results in the first 2 lines in Table 2, 
yield the expression of Jenet & Anderson (1998) for the statistically-averaged cross-power spectrum: 



Again, the constants Ax2 and Bx depend on the characteristic curve; Paper 1 presents expressions for 
them. The result holds through second order in a T . Figure 2 illustrates the resulting spike at zero lag, for 
autocorrelation. 



The variance of the correlation function measures the noise. The noise thus involves the fourth moment 
of the quantized signals xg and yg. Because the correlation function is complex, it is drawn from an elliptical 
Gaussian distribution in the complex plane, and one must determine both (ff*) and (ff) to characterize its 
noise. Both of these expressions are sums of terms of the general form (wx*y*z), or (wx*yz*). Up to 2 of 
the 4 quantities wxyz can be identical for the cross-power spectrum, and all of them can be identical for 
the autocorrelation spectrum. The identical quantities result in special cases, for quantized data, as Jenet 
& Anderson found. 

Precisely along the lines of the discussion of the second moments in the preceding section, expansion of 
the fourth moments into real and imaginary parts yields statistical averages of the form (WXYZ), where W 
X Y and Z are real quantities drawn from a multivariate Gaussian distribution. The first column of Table 
1 lists the terms important for the correlation functions. 1 expand the multivariate Gaussian distribution 
for W X Y and Z through second order in covariances pwx, Pwy, and so on; this yields the terms in 
the second column of Table 1, times ID Gaussian distributions for each variable. Multiplication by the 
quantizing functions W^VF) X(X) Y(Y) and Z(Z) and integration over the distributions yields the averages 
in the third column of Table 1. These averages of quantized real (or imaginary) quantities combine to yield 
the averages of quantized complex quantities given in Table 2. I then combine these averages, using the 
schemes summarized in Table 3 to find expressions for the variance of the cross-correlation function f . 



The noise in the modulus of the correlation function, (ff*) — (f)(f*), gives the average diameter of the 
error ellipse for f . To find this, one must calculate 



Again, I assume that covariances between terms are small, so that expansion through second order is suffi- 
cient. 




(31) 



3.6. Noise of Cross-Correlation Functions for Quantized Signals 



3.6.1. (ff*) - (f)(f*) 




(32) 



The calculation is straightforward when all 4 of the averaged elements are different: in other words, 
when I 7^ m and < + t/ hi|«. In this case, the average is proportional to that expected for continuous 
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correlation, Eq. 13: 

(x e y* e+T x* m y m+v ) = [AB 2 x B Y }p T pl + [AB 2 X B Y ] (a m _ £ a_ (m _ £)+(T _ t;) ) . (33) 

This is the average given by the term (wx*y*z) in Table 2, where it appears as "class" 1111+. The l's 
indicate that one term of each variable appears once; the "+" indicate the symmetry of average under 
multiplication of x by e l7r / 2 , or equivalently rotation by tt/2 in the complex plane. This term also appears 
in Table 3, with ID "Xcn.O". In this identifier, the "X" indicates cross-correlation, the "c" indicates the 
product of f with its conjugate: ff* , the "n" indicates that t ^ v, and the "0" indicates that the indices 
£, to, I + t, and to + v are distinct. As the table indicates under "Multiplicity," this form of term appears 
N 2 — 2N Q times in the sum. 

If r ^ v, but £ = to, then one encounters the average 

(x e y} +T x* e y e+v ) = [2(Cx2 - A X2 )B\\p T pl + [AA X2 B Y ] a (T _„). (34) 

This term has the form (wx*w*y), and "Class" 211+ in Table 2. It appears as "Xcn.l" in Table 3, and 
appears N Q times in the sum. 

If r ^ v, but I + t = to + v, one then encounters 

(xeVt+TXe+T-Je+r) = [ZB 2 X (C Y2 - A Y2 )]p T p* v + [4B 2 x A Y2 ]a (T _ v) . (35) 

This term also has the form (wx*w*y), and Class 211+ in Table 2. (Note however that the roles of x and 
y are interchanged from those in Table 2). It appears as "Xcn.2" in Table 3, and appears iV times in the 
sum. 

From Eqs. 33 through 35, I evaluate the sum, Eq. 32 (for t/v): 

1 r N ° 

= Wo? pM^ + ^E M a_ n a n+(T _ v) (36) 

- 2 x N {[AB 2 x B 2 y ] PrP l + [4B 2 x B 2 ]a a {T _ v) } 

+ N ([2(C X2 - A X2 )B Y ]p T p* v + [AA X2 B Y ]a {T _ v) ) 

+ N ([2B 2 X (C Y2 - A Y2 )] PtP * v + [4B%A Y2 ]a iT _ v) )y 

Note that the first 2 terms on the right side of this equation give the contribution for all unlike wxyz, Eq. 
33, with multiplicity 2N Q greater than correct. The second 2 terms subtract off the extras for the special 
cases £ — to and £ + r = to + v, with multiplicity of N a each; and the last 4 terms add back in the correct 
contributions for these 2 special cases (Eqs. 34 and 35), with multiplicity N Q each. Eq. 36 simplifies to: 
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Similarly, when r = v, the contributing terms are given under Xce in Table 3. The case I = m again 
presents a special situation; for t = v this case is identical to £ + t = in + v. With this special case t = m 
again included incorrectly, subtracted back off, and then added in correctly, one finds: 



(f T f;) (f T )(f;) = -^ r f^[2B%B^]a n a- n (38) 



n=l 



+ 2^ [\{Cx2 - A X2 )(C Y2 A Y2 ) 2B x B Y ]p T p* 
+ ^[2A X2 A Y2 -2B 2 X B Y ] 



3.6.2. (rr)-(f)(r) 

The variance of the correlation function, given by (ff) — (f) (f) , measures the departure of the error 
ellipse for f from circularity. As in the previous section, the averages for which 2 or more of the elements 
of the sum are identical must be calculated separately. For r ^ v, the terms appear under Xrn in Table 3. 
This yields: 

I N ° 

(f T f v ) - {r T ){r v ) = —^[2B x B Y }p ri+{T+v)P - n (39) 

° n=\ 

+ ^[{Cx2 - A X2 )B Y + B 2 x (Cy2 - A Y2 ) - AB x B y ] PtPv . 
Similarly for r = v, for which the terms appear under Xre in Table 3: 

(f T fr) - (f T )(f T ) = —J2[2B 2 x B Y ]p n+{2T) p_ n (40) 

n—1 

+ 2^ ^ {CX2 ~ ^ + B X^ Cy2 - A ^ + B ^ - *B X B Y ] P r P r 

+ [(5(C« - A X2 ) - B\)(\{C Y2 A Y2 ) B Y )]p*p*. 



3.6.3. Simulation of Cross-Correlation Function 

Figure 3 shows statistics, in the lag domain, for the simple correlation function shown in Figure 2. Plots 
on the left show (r T f *) — (f T ) (f *) , and on the right (f T f v ) — (f T ) (f v ) ■ The upper plot shows the arrangement 
of nonzero terms, and the lower plot gives their values. 

The diagonal terms are the squared standard deviations of the amplitude of f r , as given by Eq. 38. The 
off-diagonal terms give the covariances of the noise between lags, as given by Eq. 37. 

The right panels show the moments (f T f T ) — (f T )(f T ). For a real cross-correlation function (like that 
used here), the diagonal terms are the differences of the standard deviations of real and imaginary parts of 
f r , as given by Eq. 40. They thus measure the departure of the noise from isotropy in phase. These terms 
are proportional to squares or products of the cross-correlation function p. For this test data, p 2 = 0.16, and 
so these terms are smaller than the largest terms in the left panels. This indicates that the error ellipses for 
the correlation function are approximately circular. 
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3.7. Autocorrelation Functions 

Autocorrelation correlation functions and spectra present many special cases. On the other hand, for 
the autocorrelations the "zero lags" r = and v — yield unit correlation, and thus play a special role; this 
is unlike the cross-correlations, where the quantities being correlated are distinct at any lag. Fortunately, 
one needs only one of (a T a*) and {a T a v } because (a T a v ) — (a T a*_ v ). Furthermore, X and Y are the same, 
so I simplify the notation by dropping the subscripts from the integrals A, B, C. 

For the case r ^ v, we have the the general case where neither r nor v is 0, as well as the special 
sub-cases r = and v = 0. Table 4 summarizes these various cases, with identifiers Antu, AnOu and AntO. 
In these identifiers, "A" indicates autocorrelation, "n" indicates r ^ v, and "Ou" indicates r — whereas 
"tO" indicates v = 0. Within these cases we have the same special cases as for the cross-correlation function 
I = m and I + t = m + v, plus the special cases I + t = m and I = m + v, which are special cases for 
autocorrelation (although not for cross-correlation). These are listed as Antu.l, Antu. 2, etc. Some of these 
special cases become degenerate when t = or v = 0. 

I adopt the previous strategy of subtracting off, and then adding back in, contributions for the special 
cases. For autocorrelations with r ^ v, and both r ^ and v ^ 0, this requires the "Antu" terms in Table 
4. The sum simplifies to: 

(a T a* v ) - (a T )(a* v ) = — [2B 4 ] ^ a n a_ n+(T _„, (41) 

° n=l 

+^[4(<? - A)B 2 - 8B 4 ]a r a_„ + t^t^AB 2 - 4B> T _„. 

ZI\ Zl\ 

Here I have defined n = l — m. Note that I — m takes on different values in the sub-cases Antu. 3 or Antu. 4, 
as compared with Antu.l or Antu. 2, so that the correction terms are different. This equation is analogous 
to, but different from, Eq. 37, with which it should be compared. 

In the case v = 0, r ^ v (AntO in Table 4), one obtains: 

(a T a ) - (a T )(a ) ^ —[(C - A)B 2 ]Y / (a(n + r^-n) (42) 

+ ^-[2B 3 B-2CB 2 ]a T . 

Note here that B = J dX le"^ 2 X(X), whereas B 3 = J dX Xe~^ (X{X)f . (See Paper 1.) 
One obtains the analogous expression in the case r = 0, r ^ v (AnOu in Table 4). 
In the case r = v, t^0 (Aet in Table 4), one obtains: 

(a T a* T ) (a T )(a;) = ^l-[2i? 4 ]^K a _„) (43) 

n 

+ ^A 2 -2B^ + ^L[(l)({C-A) + 2B 2 ) 2 8B 4 ]K<). 
This equation is analogous to Eq. 38. Finally, in the case r = v = (AeO in Table 4), one obtains: 

(«o«S> - (a )(aS) = ^[i(C-A) 2 ]^Ka_„) (44) 

n 
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Note here that A = j dX Xe~? x2 {X{X)f, whereas A 4 = J dX Xer^ (X(X)) 4 . 



4. SPECTRA OF QUANTIZED SIGNALS 

The measured spectrum is the Fourier transform of the measured correlation function. Thus, for quan- 
tized data, the cross-power spectrum f and the autocorrelation spectrum a are: 

N-l 

f k = e l ^r kT f T . (45) 

T = — N 

d k = £ e^a T . 

T = -N 

Jcnet & Anderson (1998) show that the proportionality factor found by Cooper (1970) relates the average 
of the quantized cross-power spectrum (r) to the true cross-power spectrum p; and the same factor, with an 
offset resulting from the spike at zero lag, relates (a) to a. 

Noise in the spectrum is related to noise in the autocorrelation function by a double Fourier transform. 
I use this fact to find the noise in the spectrum, through second order in a and p, in this section. I find 
that many of the terms for noise in the correlation functions are diluted over the channels of the spectrum. 
They can be neglected, in many cases, for spectra containing many channels. I find that the dominant terms 
for noise in individual channels of the spectra are analogous to results for continuous spectra, given by Eqs. 
18 and 19. I also find that the noise is correlated between channels. This is opposite the conclusion for 
continuous data (§2.3.3). 



4.1. Mean Spectra for Quantized Signals 

The Fourier transform of the proportionality Eq. 29 yields the ensemble-averaged spectrum: 

(f fe ) = B x B Y p k , (46) 

where both sides of the expression are complex. 

The ensemble average of the Fourier transform of the quantized autocorrelation function is: 

JV-l 

(o fc ) - Yl e^ feT ar- (47) 

T=-N 

This sum contains 2N — 1 terms involving d T — B^a T , and one involving So = Ax2- I adopt the approach, 
as in calculations of noise, of including an incorrect zero-lag term will all others in the sum, subtracting that 
incorrect term, and then adding the correct term: 

(«») = ( £ e'»*'BS.c T ) -feat,) +(a x X (48) 
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This recovers the results of Jenet & Anderson (1998), who showed that the mean spectrum for quantized 
data is equal to the statistically- averaged spectrum for continuous data, plus an offset, times the gain factor 



4.2. Spectral Noise for Quantized Signals 

4-2.1. Variances: (r k rl) 

Calculation of the noise in the spectrum involves the Fourier transform of the variance-covariance matrix. 
The Appendix summarizes facts useful for this transform. The approach is analogous to that taken in §2.3.2, 
via a double Fourier transform. 1 use the facts in the Appendix, together with Eqs. 37 and 38 to find: 

(hrt) - { r k )(r* k ) = ^[2(A X2 + B%(a k -l))(A Y2 + B 2 Y (a k -l))] (49) 
+ 2^ [1(^2 - A X2 )B Y + B X \{C Y 2 - A Y2 ) - 2B x B Y ]p k ~p* k 

N-l 

-^[2{\{C X2 -A X2 )-\B%){\{C Y2 -A Y2 )-\B Y )-\BlB Y ] £ j^wl 

Note that the first term on the right-hand side is of order 2N; the second is of order 1; and the third is of 
order 1/2N. 



4-2.2. Variances: {f k f k ) 
Using the expressions in the Appendix together with Eqs. 39 and 40, I find: 

(r fe r fe ) - (r k )(r k ) = +^r[2B x B Y }p k p k (50) 

+ 7^M ^ Cx2 ~ A X2)B Y + B\(C Y2 - A Y2 ) - AB 2 x B Y ]p k p k 

+ (2Ag ^ {Cx2 Ax2) b2 ^ Cy * Ay ^ - B W J2W) ( dp{k) + & " { ~ k) ) ■ 

Again, the first term on the right-hand side is of order 27V, the second of order 1, and the third of order 
1/2N. 



4.3. Correlation of Noise Across Spectral Channels 

For quantized data, noise in different spectral channels can be correlated. The correlation of noise 
between channels involves (r k r^), with k ^ I. These covariances can be calculated by the double Fourier 
transform of Eqs. 37 and 38. 
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4-3.1. Covariances: (r k r}} 

For calculation of covariances between channels, classification of the terms in Eq. 37 and 38 is helpful. 
In Eq. 37, the first term on the right-hand side is proportional to the autocorrelation function a convolved 
with itself, the second is proportional to the square of the cross-correlation function p, and the third is 
proportional to a. Of these, only the second will contribute to the covariance between channels. None of 
the 3 terms on the right-hand side of Eq. 38 contribute either, for k ^ £. Thus, only the second term on the 
right-hand side of Eq. 37 contributes, and it contributes in a simple way: 

N-l N-l 

E E ^ {kT - tv) prPi = hPi, (si) 

t=—N v=—N 

so that 

{hr}) ~ (r k )(r* e ) = -L [(C X2 - A X2 )B Y + B 2 X (C Y2 - A Y2 ) - 4B x B Y ]p k p* e , for k ± I. (52) 

The combination of constants [(Cx 2 — A X2 )B Y + B\[Cy 2 — Ay 2 ) — 4B X B Y ] is always less than for n = 3 
(although it can be positive for other values of n), so the covariance is negative in that case. In other words, 
when noise increases the height of one spectral peak, noise will tend to reduce the heights of other spectral 
peaks. Note that the contribution of p k p* k to the variance appears in the covariance as well: this contribution 
to the noise is perfectly correlated between spectral channels. 



4-3.2. Covariances: (r k re) 

The covariances (r k rt) can be found from Eqs. 39 and 40. As in the preceding section, classification of 
the terms in Eqs. 39 and 40 is helpful. In both expressions, the first term is proportional to the convolution 
of the cross-power spectrum with itself; it does not contribute to the covariance. The other terms in Eq. 40 
also contribute nothing. We thus obtain: 

(hh) - (h)(h) = ^ r [(C X2 - A X2 )B Y + B\(C Y2 - A Y2 ) - AB x B Y ]p k p e , k^l. (53) 

The covariances have the same coefficient for variances {f k r* t ) and {r k rt) . 



4-3.3. Simulation of Cross-Power Spectrum 

I Fourier transformed each of the simulated correlation functions from the simulation and form spectra. 
The statistical properties of these spectra are in good agreement with the results of §4.2. Figure 4 shows an 
example spectrum as a phasor plot. This is the spectrum corresponding to the correlation function of Figures 
2 and 3, plotted in phasor form. The prediction is plotted as a solid line, using Fourier interpolation. The 
mean measurements in the discrete channels are plotted as points, and surrounded by error ellipses that give 
the spread. The error ellipses for each point have major axes that point toward the origin of the complex 
plane; this is a consequence of the fact that, for this choice of parameters, the first term on the right-hand 
side of Eq. 50 dominates the other 2, and it is proportional to pi- This term defines the major axis. 

Figure 5 shows a spectrum and the standard deviations plotted in more traditional form. Again, I use 
Fourier interpolation to show the model as a continuous function of the channel index, k. 
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4-3.4- Spectrally- Correlated Noise: Simulation 

Figure 6 shows an example of correlated noise in two spectral channels. For this simulation I used a 
different initial spectrum and correlator parameters, more suited to showing the covariance. Both channels 
have strong signals, with zero phase, as the spectrum in the upper panel shows. The lower panel shows results 
of simulations of correlation of quantized data. The mean values Re[(rfc] and Re[r^)] locate the centroid of 
the ellipse. Noise gives the ellipse extension. The covariance of noise tilts the ellipse: when f k is smaller 
than its mean, rg tends to be larger; and vice versa. This demonstrates the correlation of noise between two 
channels. 

Comparison of Eqs. 52 and 53 shows that the correlated noise is in phase with the underlying signals: in 
other words, if both r k and re are real, then the noise between real parts is correlated, but the imaginary parts 
are uncorrelated. Thus, the figure corresponding to 6 for imaginary parts would show an ellipse centered at 
the origin, with principal axes aligned with the coordinate axes. 



4.4. Autocorrelation Spectra 

For the autocorrelation function, the special cases of r = 0, or v = 0, or both, described by Eqs. 42 and 
44, lead to additional correction terms that must be included in the sums. 

It is useful to classify the terms in Eqs. 42 and 44. Some involve a factor of the autocorrelation of the 
autocorrelation function a T , J2n=i a n+ T oi-n ■ Others involve a simple factor of a T , or the product a T a- v . 
Finally, some terms in the special case r = v = do not involve a at all: they are constants. These 3 types 
of terms Fourier transform in different ways. The additional correction terms also have terms of the first 
and second sort. The Appendix gives expressions helpful for the three sorts of Fourier transforms. 

The Fourier transform of Eqs. 41 through 44 yields: 

(a k a* k ) - (a k }(&l} = ^[2(A + Bi(& k -l)) 2 } (54) 

where for simplicity I have omitted terms smaller by a factor of l/(2iV) or more. The complete expression 
includes additional terms of these orders, but they are small for spectra containing more than a few channels. 
Note that, again, the noise in the spectral domain can be represented by the "digitization noise," a spectrally- 
constant noise (A — B)/B added in quadrature with the signal a k . 



4.5. Correlation of Noise Across Spectral Channels 

Just as in the case of the cross-power spectrum, the variation of noise on the correlation (explored 
in Paper 1) leads to correlations in the spectral domain for the autocorrelation spectrum. An argument 
precisely analogous to that for the cross-power spectrum, in §4.3.1 above, shows that only the second of the 
3 terms in Eq. 41 contributes to the covariance. That covariance is given by: 

(a k a* e ) - (a fc ) (a?) - ±- [4(C - A)B 2 8B 4 ] a k a* e . (55) 

This expression should be compared with Eq. 53. The covariance is twice as great for the autocorrelation 
function. 
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5. DISCUSSION 

5.1. Quantization Noise: One of Many Channels 

In the limit of spectra with many channels, 27V >> 1, the noise in one particular channel is given by 
terms in Eqs 50 and 49 with coefficient 27V for cross-power spectra. In this approximation, 

(r k f* k ) « WW ) + ^[2B»^](a fc +(^-l))(a fc +(^-l)) (56) 
27V 

(hh) « (Wfc> + ^-[2B%Bl]p k p k (57) 

These equations closely resemble the expressions for noise for continuous correlation, Eqs. 20 and 20, except 
that everything has been multiplied by the gain factor B^B Y , and a white noise component with variance 
(4?F — 1) (or the corresponding quantity for Y) has been added to the autocorrelation spectrum ak- These 
factors are those represented in the gain of the quantized cross-power spectrum (see Eq. 46), and in the gain 
and offset of the autocorrelation spectrum (see Eq. 46). Note that Ax2 > B\ for all (vo, n), so that the 
added noise component is always positive. This component is conveniently interpreted as quantization noise. 
In this particular approximation, treatment of the effects of quantization as white noise added in quadrature 
is accurate. 



5.1.1. Correlation of Noise and Noise Reduction 

Because the noise in different spectral channels is covariant (often with negative covariance), the in- 
tegrated noise across a spectral channel is different from the summed, squared values of the noise in each 
channel (often less). Eqs. 52, 53, and 55 give the covariances. Although the covariances are smaller than 
the variances of the spectral channels given above by factors of 27V, they sum coherently across the channel, 
whereas the variances do not. Thus, in principle they yield comparable contributions when summed over all 
channels. In practice, of course, the results of such a sum are given by Eqs. 38 and 40 with r = 0, or Eq. 44 
for autocorrelation, because the sum over all spectral channels yields the zeroth lag. The interested reader 
can verify that the results for this lag are identical to those of Paper 1, for a white spectrum. 

In principle, the reduction of noise by the covariances offers the possibility of reducing quantization noise 
in a spectrally-narrow signal. For example, one could introduce additional correlated signals, with known 
&k and pk, and measure the variation of those from theoretically-expected results. Using Eqs. 52, 53, and 55 
one can calculate what weighted sum of those variations should be applied to the unknown signal, to reduce 
the noise as much as possible. This potential application is closely related to "dithering" in quantization 
(see, for example, Balestrieri et al. (2005) and references therein). 



5.2. Symmetries 

Note that the noise in the cross-correlation function depends on both a and p. The variance {rkr* k ) — 
(fk)(r1) measures the summed squares of the principal axes of the elliptical Gaussian distribution of noise, or 
its overall size. As one might expect from Eq. 18, that size depends primarily on the autocorrelation spectrum 
in that channel <S fc . The error ellipse must maintain the same size under the transformation p — > e^p, so 
the noise can depend only on even powers of a, as it does. 
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Similarly, the variance (rk?k) — (^fe)(^fc) measures the difference of the squares of the principal axes of 
the elliptical Gaussian distribution of noise, or its shape. This shape must be circular for p = 0, so that 
the variance must vanish there, and so one expects that it cannot depend on a independently of p. Eq. 
19 confirms this. The difference must remain the same under the transformation p — > — p, for example, so 
dependence on p must be second order. 

5.3. Limits of Validity 

Numerical experiments suggest that Eqs. 49 and 50 reach their limits most commonly for spectra 
encountered in radio astronomy when the autocorrelation function becomes large at lags other than the 
zero lag. For example, for a single narrow line, when the integrated power in the line becomes comparable 
to the integrated continuum (including system noise), then the autocorrelation function will reach about 
0.5 in nonzero lags. This usually leads to noise larger than that expected from the second-order analytical 
expressions, especially in channels containing the line, but also throughout the spectrum. 

For particular spectra, the additional noise can be modeled accurately by expressions that involve 
higher-order terms allowed by the preceding discussion, such as a.up\ or a\. 

6. SUMMARY 

This paper investigates signal and noise for correlation of digitized data. I assume that the received 
data are noiselike, in the sense that amplitudes and phases are drawn from complex Gaussian distributions 
in the spectral domain. The variance varies with frequency. For cross-correlation of two data streams, 
covariance between the data streams may also depend on frequency. Almost all astrophysical signals have 
this character. The variances and covariances contain all the information in the signal. The observed time 
series are the Fourier transforms of these spectral components. At millimeter and longer wavelengths, these 
time series are commonly digitized, and then correlated to obtain estimates of the underlying variances and 
covariances. The correlation functions are finally Fourier transformed to yield the estimated autocorrelation 
or cross-power spectrum. Averaged over a number of realizations, the elements of the correlation function will 
approach a Gaussian distribution. The mean correlation represents the deterministic part of a measurement, 
or the signal. The standard deviation of the measurement represents the random part, or noise. 

Digitization of the signals involves quantization, which represents the continuous signal with a finite set 
of levels, and thus destroys information. This affects both the signal and the noise. I summarize results for 
continuous data in §2, and present new results, for noise for quantized data, in §3 and §4. 

In §3 I investigate statistics of correlation functions. Under the assumption that the correlation is 
smaller than 1 (except equal to 1 for the zero-lag of the autocorrelation function), I find expressions for the 
mean cross- and autocorrelation functions. Results agree with earlier work (Cooper 1970; Jenet & Anderson 
1998). I then find analytical expressions for the noise in the correlation functions. This noise takes the 
form of variances of the measured elements, as a function of lag; and of covariances between the measured 
elements. 

In §4 I investigate statistics of spectra. The mean spectra are related to the mean correlation functions 
by Fourier transform; the noise in the spectra is related to that in the correlation functions by a double 
Fourier transform. I find that the mean cross-power spectrum for quantized data equals that for continuous 
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data, times a gain factor. The mean autocorrelation spectrum equals that for continuous data times the 
same gain factor, plus white noise added in quadrature with the original data: "quantization noise". This 
accords with previous results (Cooper 1970; Jenet & Anderson 1998). I then find analytical expressions 
for the noise in the spectra. For both cross-power and autocorrelation spectra, I find that noise in one 
channel of a spectrum is equal to a gain factor times that for continuous data, plus the same quantization 
noise found for the autocorrelation spectrum. However, I also find that noise is correlated (most commonly 
anticorrelated) across spectral channels. Thus, when noise increases the value measured in one channel above 
the mean, noise will tend to decrease the value measured in another channel. This correlation can produce 
a contribution comparable to, or even greater than, the quantization noise when summed over all spectral 
channels. 

I am grateful to the DRAO for supporting this work with extensive correlator time. I gratefully ac- 
knowledge the VSOP Project, which is led by the Japanese Institute of Space and Astronautical Science 
in cooperation with many organizations and radio telescopes around the world. The U.S. National Science 
Foundation provided partial financial support for this work. 



A. Useful Facts for Spectra 



Parseval's theorem states: 



N-l , N-l 



E P'Pt = 4E hPu- (Ai) 



2N 

T——N k=-N 



Therefore, 



Also note that 



N-l 

E ^ k(T - v) PrPl = PWl - T^n E hPk- (A2) 
J2 e^ k ^a (T _ v) = (2N)a k - (2N) (A3) 



N-l No 



J2 e^ k J2una- n+ „ = (2N)ai (A4) 



v=—N n=l 

For convolutions, recall that 

N-l N-l N 



E E e i ^ T - v ^p n p_ n+(T _ v) = (2N)p k p k . (A5) 



t= — N v=-N 



where I assume that the correlation function wraps, and that the correlation function includes all lags with 
nonzero signal. 



I define the quantity: 



N-l 



C p {k)= E ^ 2kT PrPr- (A6) 



r=-N 
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Fig. 1. — Characteristic curve for 4- level quantization. 
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Fig. 2. — Model spectra and correlation functions for simulations of correlation. Upper panel: Cross-power 
spectrum fk (circles) and autocorrelation spectrum a.k (crosses) . Curves show interpolated spectrum. Middle 
panel: Cross-correlation function r T and autocorrelation function a T for continuous data. Lower panel: Cross- 
correlation function f T and autocorrelation function a T for quantized data. Note the gain for cross-correlation 
of f T = B x B y i)A = 0.693 for r = 1,2, and offset to ciq = 2.07 for the zero-lag autocorrelation. Data were 
quantized with vq = 1.5 and n — 3. Correlation includes 2N = 8 lags. When averaged over iV = 2 x 10 6 
simulated correlation functions, the simulated spectra and correlation functions are indistinguishable from 
theoretical values. 
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Fig. 3. — Noise for cross-correlation function shown in Figure 2. Upper panels: Schematic depiction of the 
correlation matrices (r T r*) — (fv)(p£) (left panel: Equations 37 and 38); and (r T r v ) — (r T )(r v ) (right panel: 
Equations 39 and 40). Letters indicate positions with expected nonzero standard deviation, according to 
those equations, with the same standard deviation expected for identical letters. Lower panels: corresponding 
noise, as found for a 4-level correlator for the spectrum of Figure 2. Standard deviations are for N a = 16 
measurements with 2N = 8 lags, calculated over 10 6 simulated correlation functions. Circles show statistics 
of the simulations, and horizontal bars show predictions of Eqs. 37, 38, 39, and 40. 



- 25 - 



t 1 1 1 1 1 1 1 1 1 1 1 r 




I I I I I I I I I I I I I I 

-1 1 

Fig. 4. — Spectrum for model correlation function of Figures 2 and 3, in phasor form. Solid line shows 
expected form, using Fourier interpolation. Ellipses show measured averages and standard deviations. Sim- 
ulations used a 4-level correlator with vo = 1.5, n = 3 with iV Q = 16, 2N = 8. The displayed statistics were 
calculated from 10 7 simulated spectra. The value of i; was chosen to emphasize the eccentricity of the error 
ellipses; in other words, of the size of the term (r^r^). Note that major axes point toward the origin. 
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Channel k 

Fig. 5. — Model spectrum and noise, shown for simulations (circles: real parts, stars: imaginary parts), and 
for theory (solid line: real part, dotted line: imaginary part). Simulations used a 4-level correlator with 
v a = 0.4, n = 3 with iV Q = 16, 2N = 8, and 10 7 simulations. The level v was chosen to emphasize the 
p-dependent term in Eq. 49, which appears as the variation from a constant value in the middle panel. 
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Fig. 6. — Covariance of noise in two spectral channels, for simulated correlation of quantized noise. Upper 
panel: Model spectrum, showing autocorrelation spectrum a and cross-power spectrum p. All of the cross- 
power, and 80% of the autocorrelation spectrum, is concentrated into channels —3 and +1. Lower panel: 
Distribution of noise in channels 1 and -3, realized from the model spectrum after quantization. Quantizer 
parameters were vo = 0.1, n = 3. Simulations used N a = 800 measurements, 2N = 8 spectral channels. 
Points show 10 4 realizations. Ellipses show 1- and 2-standard deviation contours. The tilt of the ellipse 
shows the negative covariance of the noise in the two channels. 
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Table 1. Second and Fourth Moments of Quantized Real Gaussian Variables 





Terms of 2nd or Lower Order 


Moments of 


Average 


that Contribute to Expansion 


Quantized Variables 


(WX) 


[WX]{p wx ) 


[BwB x \pwx 


(W 2 ) 


[1] 


[Aw*] 


(WXYZ) 


[W XY Z](pw x pY z + pwypxz + pwzpxy) 


[BwB x ByBz](pwxpyz + pwypxz + pwzpxy) 


(W 2 XY) 


[XY](p XY ) + [(W 2 - l)XY]{p wxPwY ) 


\AwiB x By](pxy) + [(Cw2 — Awi)B x By](pwx Pwy) 


(W 2 X 2 ) 


[l] + [\{l-W 2 ){l-X 2 )]( Pwx 2 ) 


[Aw2A X 2\ + [2(^2 — Aw2){C X 2 — A X 2)]pwx 2 


(W 3 X} a 


[WX]{p wx ) 


[Bw3,B x ]p wx 


(W 4 ) a 


[1] 


[A W i] 



a Important only for autocorrelations. 
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Table 2. Fourth Moments of Quantized Complex Gaussian Variables: w x y and z 
Class Form Result: Quantized 

11 (w x*) [2B w B x ]pwx 

2 (w w*) a [2A W2 ] 

1111+ (wx*y*z) [4B w B x B y Bz}(pwxPyz* + PwyPxz*) 

mi- (w x*y z*) [AB w B x B Y Bz]{pwxPYZ + PwzPxy*) 

211+ (w x*w*y ) [2{C W2 - A W2 )B x By}(pwxPwy*) + [4A W2 B x By](pxy*) 

2ii- (w x*w y*) [2{C W2 - A W2 )B x By + 4B% v B x B Y }(pwx Pwy) 

22+ (w x*w*x ) [{Cw2 - A W 2)(C X2 - A X2 )](pwxpwx*) + [4:Aw2A X2 ] 

22- (w x*w x*} [\{{C W 2 - A W2 ) + 2B^){{C X2 - A X2 ) + 2B 2 x )](p wxPwx ) 
+[\{{C W 2 - A W2 ) - 2B 2 W )((C X2 - A X2 ) - 2B x )](p wx * Pwx *) 

31+ (w w*w*x ) a [2B W3 B X + 2A W2 B w B x ]p wx * 

31- (w w*w x *) a [2B W3 B X + 2A W2 B w B x \p wx 

4 (w w*w*w ) a [2A W 4 + 2A 2 W2 ] 



Important only for autocorrelations. 
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Table 3. Terms in XCF Sums: ff* and rr 



ID 


Conditions 






Subscript 




Class 


Form 


Multiplicity 


Notes 






a 


b 


c 


d 


















Y P . / 
-A.C y 


r T K) = (x, 


iVl+T^milm+v) — 


aVb^cVd) 






Xcn: t ± 


v. 


















Xcn.l 


£ = m 


£ 


£ + T 


£ 


£ + v 


211+ 


(w x*w*y ) 


N 


Eq. 41 


Xcn.2 


£ + t = m + v 




£ + T 


£+(t-v) £ + t 


211+ 


(w x*w*y ) 


N 


Eq. 42,a 


Xcn.3 


1 + t = m 










1111 + 


(w x*y*z ) 




b 


Xcn.4 


£ = m + v 










1111 + 


(to x*y*z ) 




b 


Xcn.O 


4 distinct 


£ 


£ + T 


m 


m + v 


1111 + 


(to x*y*'z ) 


N 2 - 2N 


Eq. 40 


Xce: t = 


V 


















Xce.l 


£ = m 


£ 


£ + T 


£ 


£ + T 


22+ 


(to x*w*x ) 


No 




Xce.O 


4 distinct 


£ 


£ + T 


m 


m + t 


1111 + 


(to x*y*z ) 


N 2 - N 










Xr: ( 


f T f v ) = {x, 


iVe+T^mym+v) — (x a ylx c y* d ) 






Xrn: r ^ 


v. 


















Xrn.l 


£ = m 


£ 


£ + T 


£ 


£ + v 


211- 


(to x*w y*) 


No 




Xrn. 2 


I + t = m + v 


£ 


£ + T 


£+(t-v) £ + t 


211- 


(to x*y w*) 


No 


a 


Xrn. 3 


£ + t = m 










1111- 


(to x*y z*) 




b 


Xrn.4 


£ = m + v 










1111- 


(to x*y z*) 




b 


Xrn.O 


4 distinct 


£ 


£ + T 


m 


m + v 


1111- 


(to x*y z*) 


N 2 - 2N 




Xrc: t = 


V 


















Xrc.l 


£ = m 


£ 


£ + T 


£ 


£ + T 


22- 


(w X*W X*) 


No 




Xre.O 


4 distinct 


£ 


£ + T 


m 


m + t 


1111- 


(to x*y z*) 


N 2 - No 





a Roles of x and y reversed from Table 2. Use complex conjugate. 

b Important only for autocorrelations. Yields standard form for cross-correlation. 
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Tabic 4. Terms in ACF Sums: ad* 



ID Conditions 






Subscript 




Class 


Form 


Multiplicity 


Notes 




a 


b 


c 


d 
















ACF: ( 


a T a* v ) = (x t 




) — {%a%b 








Antu: t ^ v, r ^ 0, v ^ 


















Antu.l l = m 


£ 


£ + T 


£ 


£ + v 


211 + 


(w x*w*y ) 


N 




Antu. 2 £ + t = m + t> 


£ 


£ + T 


£+{t-v) 


£ + T 


(211 + )* 


(x w*y*w ) 


N 


a 


Antu. 3 £ + t = m 


£ 


£ + T 


£ + T 


£ + T + V 


(211-)* 


(x w*w*y ) 


N 


a 


Antu. 4 £ = m + v 


£ 


i 

t + r 


£ — v 


£ 


211- 


{w x y w ) 


N 




Antu.O 4 distinct 


£ 


l + T 


m 


m + v 


1111+ 


(w x*y*z ) 


Nl - AN 




AnOu: r^«, t = 0: 


















AnOu.l £ = m 


£ 


£ 


£ 


£ + v 


31+ 


(w w*w*x ) 


No 




AnOu.2 £ = m + v 


£ 


£ 


£-v 


£ 


31- 


(w w*x*w ) 


No 




AnOu.O 3 distinct 


£ 


£ 


m 


m + v 


211 + 


(w w*x*y ) 


Nl - 2N Q 




AntO: r ^ i>, v = 0: 


















AntO.l £ = m 


£ 


£ + T 


£ 


£ 


31- 


(w x*w*w ) 


No 




AntO. 2 £ + t = m 


£ 


£ + T 


£ + T 


£ + T 


31+ 


(x w*w*w ) 


No 




AntO.O 3 distinct 


£ 


£ + T 


m 


m 


211 + 


(x y*w*w ) 


N 2 D - 2N 




Aet: t — v, t ^ 0: 


















Aet.l £ = m 


£ 


£ + T 


£ 


£ + T 


22+ 


(w x*w*x ) 


No 




Aet. 2 £ = m + r 


£ 


£ + T 


£-T 


£ 


211- 


(w x*y*w ) 


No 


a 


Act. 3 £ + t = m 


£ 


£ + T 


£ + T 


£ + 2t 


(211-)* 


(x w*w*y ) 


No 


a 


Act.O 4 distinct 


£ 


£ + T 


m 


m + t 


1111+ 


(to x y z ) 


N 2 D - 3N 




AeO: t = v, r = 0: 


















AcO.l £ = m 


£ 


£ 


£ 


£ 


4 


(to w*w*w ) 


No 




AeO.O 2 distinct 


£ 


£ 


m 


m 


22+ 


(to w*x*x ) 


N 2 - N 





a Complex conjugate of element in Table 2. 



